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SELECTING A TARGET OBJECT IN THREE-DIMENSIONAL SPACE 



TECHNICAL FIELD 

This invention relates to selecting a target object in 
5 virtual three-dimensional (3D) space - 

BACKGROUND 

A virtual 3D space includes objects that are either link 
objects or non-link objects. Non-link objects represent data, 

10 such as Microsoft® Word® documents. Link objects connect non- 
link objects to one another. That is, link objects represent 
the relationship of one non-link object to another non-link 
object. For example, a "table of contents" (i.e., a non-link 
object) may contain links to several documents referenced in 

15 the table . 



DESCRIPTION OF THE DRAWINGS 



FIG. 1 is a view of a target object in virtual 3D space. 



FIG. 2 is a 3D view of ob j ects in the 3D space . 



FIG. 3 is a view of a link object with an extended area. 



20 



FIG. 4 is a view of a link object with an extended area 



after the process of Fig. 5 is executed. 



FIG. 5 is flowchart of a process for selecting a target 



object in 3D space. 



-1- 



Docket No. : 10559/ 



I1/P10866 



FIG. 6 is a block diagram of a computer system on which 
the process of Fig. 5 may be implemented. 



FIG. 1 shows objects in a 3D environment. The objects 
include non-link objects, such as objects 6, and link objects, 
such as objects 3. Non-link objects represent data. The data 
can be a computer file or any defined set of information. For 
example, a word processing document, a set of computer 
instructions, or a list of information could all be 
represented by non-link object 6. 

A user may select a non-link object 6 in order to access 
data located within the non-link object or to manipulate its 
location and properties. The selected non-link object is 
referred to herein as "target object 4". A user selects 
target object 4 by moving a cursor over the object in 3D space 
and pressing a key on a keyboard or mouse. An object may be 
selected for a number of reasons. For example, a user may 
want to change the name of the file represented by the object 
or to open the file. Once selected, the user has access to 
the file to make any necessary changes. 

FIG. 1 also shows link objects 3. Link objects 3 may be 
depicted as lines or curves. Link objects 3 represent 
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relationships between non-link objects 6. An association 
between a target object 4 and a non-link object 6a is formed 
by connecting a first end 10 of link object 3a to target 
object 4 and a second end 11 of link object 3a to non-link 
object 6a. For example,* target object 4 may represent a 
directory of files on a personal computer and non-link object 
6a may represent a file located within the directory. Several 
link objects 3 may connect to a single non-link object 6, as 
shown in FIG. 1. 

In the virtual 3D space of FIG. 1, a link object 3 may be 
positioned in front of a non-link object 6. A user may want 
to select a link object 3 to change relationships among non- 
link objects 6. Link object 3 may be selected anywhere along 
link object 3, e.g., from end 10 to end 11. 

Referring to FIG. 2, a virtual camera 50 is located at an 
arbitrary point in the virtual 3D space. A distance (depth) 
56 is measured from camera 50 to an object 51. Distance 
(depth) 58 is the distance between camera 50 and object 52. 
Distance 56 is shorter than difference 58. Accordingly, 
object 51 is considered closer to camera 50 than object 52 in 
the virtual 3D space. Generally speaking, when placing a 
cursor on two objects, the closer object to the camera 50 is 
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selected. The exception to the general rule is described 
below. 

Referring to FIG. 3, an extended area 9 represents a 
tolerance area for each link object. This tolerance area is 
5 generally on the order of several pixels around the link. 
Selecting a pixel in the tolerance area causes the 
corresponding link also to be selected. This can result in 
erroneous object selection, as explained below. 

More specifically, the user does not see extended area 9, 

10 i.e., it is not displayed on screen. As shown in Fig. 3, a 
link object 3a can be placed in front of target object 4. 
Since the area from which to select target object 4 is only 
approximately a few pixels high and wide centered around the 
cursor point, extended area 9 can interfere with the selection 

15 of target object 4. Thus, a user who attempts to select 

target object 4 could not select target object 4. This is 
because extended area 9 of link object 3 is closer to camera 
50 than target object 4. As a result, attempting to select 
target object 4, e.g., at point 7, would actually cause link 

20 3a to be selected and not target object 4. 

Referring to FIG. 5, a process 20 is shown for preventing 
extended area 9 from extending over target object 4 and 
obstructing a user's ability to select target object 4. 
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Process 20 takes into account whether an object is a link 
object 3 or non-link object 6 during selection, as described 
in detail below. 

Briefly, process 20 gives precedence to non-link objects 
that are obscured by link objects by a predetermined number of 
pixels in the z-direction of 3D space. The effective result 
of process 20 is shown in FIG. 4. That is, for all intents 
and purposes, the extended areas 9 over non-link object 4 are 
ignored, allowing the user to select target object 4 
relatively easily. 

In more detail, process 20 receives (21) coordinates 
based on user input. For example, a user may select target 
object 4 by pointing and clicking using a mouse. Process 20 
locates (22) the objects in 3D space under the cursor at the 
user-selected coordinates. Because two or more objects, 
including the extended area, may overlap in the z-direction, 
more than one object may be located at the user-selected 
coordinates. This is because user-selection is made in the x- 
y plane of the computer screen. Process 20 obtains object 
characteristics for each selected object. Those 
characteristics include the position of the object and its 
type. The type of each object may include information such as 
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whether an object is a non-link object or a link object. The 
position of each object may be the object's xyz coordinates. 

Process 20 identifies (23) the selected objects by 
analyzing the objects' characteristics. Process 20 labels 

5 each object, including target object 4, based on whether each 
object is a link object or a non-link object. For example, 
process 20 labels link objects as link objects and non-link 
objects as non-link objects. Process 20 determines (24) 
distances between the user-selected objects and camera 50 

10 using the positions for each object. Process 20 does this by 
taking the difference between coordinates of locations of the 
various objects. For example, referring to FIG. 2, the 
distance 56 between camera 50 and object 51 is the difference 
in the Cartesian xyz coordinate values of camera 50 and object 

15 51. 

Process 20 prioritizes (25) the objects based on the 
objects' distance from one another and the identities of the 
objects. Object priorities may be stored in a list in memory 
and retrieved by process 20 when necessary. Generally, link 
20 objects 3 are given a lower priority than non-link objects 6. 
For example, a non-link object 6 and a link object 3 may have 
the same distance (depth) relative to camera 50. Process 20 
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nevertheless assigns non-link object 6 a higher priority than 
link object 3. 

In another case, such as that shown in FIG. 3, link 
object 3 is actually closer to camera 50 than target object 4. 
In this case, process 20 gives priority to non-link object 6 
only if it is less than a certain distance (depth) from link 
object 3 relative to camera 50. Otherwise, process 20 gives 
priority to link object 3. Thus, for link object 3a to be 
selected, for example, link object 3a must be closer to camera 
50 than target object 4 by a predetermined distance. 

Process 20 selects (26) target object 4 from among the 
objects using the stored priorities for the objects. By way 
of example, assume that target object 4 and link object 3a 
(via its extended area) are both "clicked on" by the user. 
Process 20 will select object 4 if (1) it is a non-link object 
and (2) object 4 is less than a predetermined distance (i.e., 
number of pixels) behind any overlapping link object 3. The 
distances are determined with respect to camera 50. If these 
two criteria are not met, process 20 will select link object 
3a . 

In one embodiment, an OpenGL depth buffer provides 
information to prioritize selection of objects. Using OpenGL, 
all objects under the cursor are tagged with depth information 
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normalized between 0 and Oxfffffff, front to back. As 
described above, non-link objects 6 have priority over link 
objects 3 up to a predetermined depth difference. In this 
example, for a link object 3 to be selected there must be a 
5 depth difference of less than 0x1000000 between the link and 
non-link objects. 

FIG. 6 shows a computer 30 for selecting a target object 
4 using process 20. Computer 30 includes a processor 33, a 
memory 39, a storage medium 41 (e.g. hard disk), and a 3D 

10 graphics processor 41 for processing data in 3D space of FIGS. 
1-4. Storage medium 41 stores the 3D data 44 which defines 
the 3D space, and computer instructions 42 which are executed 
by processor 33 out of memory 39 to select a target object 
using process 20. 

15 Process 20 is not limited to use with the hardware and 

software of FIG. 6; it may find applicability in any computing 
or processing environment and with any type of machine that is 
capable of running a computer program. Process 20 may be 
implemented in hardware, software, or a combination of the 

20 two. Process 20 may be implemented in computer programs 
executed on programmable computers that each include a 
processor, a storage medium readable by the processor 
(including volatile and non-volatile memory and/or storage 
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elements), at least one input device, and one or more output 
devices. Progra^f code maybe applied to data entered using an 
input device to perform process 20 and to generate output 
information. 

Each such program' may be implemented in a high level 
procedural or objected-ofl^nt'ed programming language to 
communicate with a computer system. However, the programs can 
be implemented in assembly or machine language. The language 
may be a compiled or an interpreted language. Each computer 
program may be stored on a storage medium or device (e.g., CD- 
ROM, hard disk, or magnetic diskette) that is readable by a 
general or special purpose programmable computer for 
configuring and operating the computer when the storage medium 
or device is read by the computer to perform process 20. 
Process 20 may also be implemented as a computer-readable 
storage medium, configured with a computer program, where upon 
execution, instructions in the computer program cause the 
computer to operate in accordance with process 20. 

The invention is not limited to the specific embodiments 
described herein. For example, the invention can prioritize 
non-link and link objects differently, e.g., give general 
priority to link objects over non-link objects. The invention 
can be used with objects other than non-link objects and link 
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objects. The invention is also not limited to use in 3D 
space, but rather can be used in N-dimensional space (N^3) . 
The invention is not limited to the specific processing order 
of FIG. 5. Rather, the specific blocks of FIG. 5 may be re- 
5 ordered, as necessary, to achieve the results set forth above. 

Other embodiments not described herein are also within 
the scope of the following claims. 

What is claimed is: 
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